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(57) Abstract: The invention relates to a voicemail short messaging 
method (10, 20, 30) and means and a subscriber terminal (500). In 
particular it concerns a method and means for instantaneous packet 
switched voicemail between Internet compatible computers, personal 
digital assistants, telephones and mobile stations. In particular the 
inventive subscriber terminal (500) concerns a hardware and a software 
setup that allows the combined use of audio and/or video devices (550) 
with both the normal cellular or fixed telephony network (520) and with an 
Internet connection (510). The inventive subscriber terminal (500) allows 
the flexible use of both the Internet and telephony network with numerous 
advantages, one of which is the inventive voicemail short messaging 
method under study. The inventive voicemail messaging method (10), 
comprising at least one subscriber terminal is characterised by server 
independence. 
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Voicemail Short Message Service method and means and a subscriber terminal 

The invention relates to a voicemail short messaging method and means and a 
subscriber terminal. In particular it concerns a method and means for instantaneous 
5 voice mail between Internet compatible computers, personal digital assistants, 
telephones and mobile stations. In particular the inventive subscriber terminal 
concerns a hardware and a software setup that allows the combined use of audio 
and/or video devices with both the normal cellular or fixed telephony network and 
with an Internet connection. 

10 

Prior art packet switched voicdmail features methods where the voicemail is 
delivered between GPRS and/or UMTS mobile stations. The voicemail messages are 
sent to an IP-address or an ISDN address. One prior art packet switched voicemail 
method is described in the WO 00/02367 publication, which is taken here as 
15 reference. 

Prior art subscriber terminals typically do not allow the seamless interplay of the same 
audio and/or video devices with both the Internet connection and the telephony 
network connection. For example, WAP- compatible mobile phones lack the facility 
20 to use the telephony audio devices when browsing the Internet. 

The prior art has several disadvantages. Firstly the prior art method is only applicable 
for sending voicemail between a limited number of devices, i.e. mobile stations. 
Second, the use of IP-address or ISDN-address is conceptually difficult. It is also 
25 technologically difficult, especially in cases where the receiver does not have a 

permanent IP-address, but rather a dynamic one. Thirdly, a specific voicemail central 
server is an essential requirement for the prior art method. This introduces 
unnecessary network hardware. 



30 



Prior art mobile subscriber terminals do not allow the use of audio features with the 
Internet connection. This limits the facility to arrange IP conferences, make Internet 
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calls, operate hyperlinks and send and reproduce packetized audio/video data, such as 
voicemail, seamlessly. 



The purpose of the invention is to remove the aforementioned disadvantages. 
5 The present inventive method allows voicemail to be sent directly to telephone 
numbers in a flexible manner from both software applications and mobile stations. 
The inventive method and means allows instantaneous voicemail to be sent and 
received from and to any Internet compatible device on the basis of the telephone 
number of that device, or other directory information of that device. There will only 
10 be an optional need for a central server storing the messages. 

IP-conferences and Internet calls maybe arranged with Hie telephony audio devices in 
accordance with the inventive subscriber terminal. Likewise, voice hyperlinks are easy 
to operate with the same audio devices. The transmission, reception and reproduction 
15 of packet switched voice mail will also be seamless with the subscriber terminal in 
accordance with the invention. 

hi addition, the purpose of the invention is to introduce a favourable inventive user 
interface and method for exchanging voicemail seamlessly and instantaneously 
20 between IP-addresses, email-addresses, telephone numbers, and/or ISDN addresses. 

Most or all of the aforementioned advantages of the invention are preferably 

implemented with a special exemplary embodiment of the invention, in which 

a recipient is chosen from the electronic phone book of a mobile station by pressing a 

25 button. The button is held down as the message is being dictated. The dictation is 

recorded in packet switched format to a data file on the mobile station or on a server 
in the network or on the Internet, in which case there will be a communications 
connection open to the server from the mobile station. Once the button is released the 
recording is finished and the data file will be sent to the recipient. Compression and 

30 cryptography methods may be employed with the data file and/or the packet stream. 
The data file may be sent either to the telephone number of the recipient directly, or to 
an IP-address of the recipient through the Internet by a variety of transmission 
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protocols, such as TCP-, IP-, UDP-, H323-, HTTP- SMS-, MMS- or any other 
protocol or message delivery service. The IP-address of the recipient may be found 
from a central lookup server on the basis of the telephone number of the recipient, 
name or other information. Likewise, the telephone number may be found on the basis 
5 of the IP-address or other information related to the recipient by querying the lookup 
server. 

Once the data file has been received, it can be played immediately at the mobile 
station of the recipient by pressing a button. The user may also reply to the voicemail 

10 immediately with another recording. If the recipient mobile station cannot be reached, 
the message may be stored on a central server in the network or on the Internet for an 
indefinite time. If the receiving terminal is unable to play the recorded format, it may 
also be adapted on the central server to a suitable packet switched data format, or 
alternatively it can be played down the phone line to the recipient through a voice or a 

1 5 data connection. 

In some preferable embodiments the voice message is streamed to the recipient 

through the Internet in real time, and the receiver may play it in real time. 

In some embodiments the subscriber terminal is a virtual software telephone in a PC. 

20 This software is preferably compatible to communicate with the mobile stations 
directly. The communication with the messages outlined here is faster than with 
contemporary SMS-messages, emails or telephone calls as the user neither has to 
write the messages with an often limited keyboard, nor has to wait for the recipient to 
answer on the other end. Very fast voicemail "ping-ball" is made possible by the 

25 outlined preferred embodiment of the invention. 

Most or all of the aforementioned advantages of the invention are preferably 
implemented with a special exemplary embodiment of the inventive subscriber 
terminal, in which the audio and video software of the subscriber terminal has the 
30 ability to control both the Internet and normal telephony network connections. This 

allows the arrangement of IP-conferences by a setup signal that is transmitted through 
the telephony network. This allows seamless transmission; reception and processing 
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of packet switched voicemail between both mobile stations, PCs and other terminals. 
The inventive software allows seamless IP-conferences between PC's and mobile 
stations. It also allows the efficient deployment of voice hyperlinks from the 
subscriber terminal. In some preferable embodiments it also allows least cost routing. 
5 Choices of whether to form IP-conferences or route through a normal telephony 

carrier can be made on the basis of economic and quality of service (QoS) criteria with 
this inventive subscriber terminal and related software, in some preferable 
embodiments. 

10 A voicemail messaging method, comprising at least one subscriber terminal, 
characterised by the steps of,' 

- choosing at least one message recipient or a group, 

- recording at least one voice/video message, 

- writing at least one recording to at least one data file, 

15 - transmitting at least one data file to at least one recipient via telephony network or 
the Internet, 

A voicemail messaging method, comprising at least one subscriber terminal, 
characterised by the steps of, 
20 - choosing at least one message recipient or a group, 

- recording at least one voice/video message, 

- streaming data packets to at least one recipient via telephony network or the 
Internet, 

- at least one recipient receives and/or reassembles packet stream, 

25 

A voicemail messaging method, comprising at least one subscriber terminal, 
characterised by the steps of, 

- choosing at least one message recipient, 

- recording at least one voice/video message, 

30 - writing at least one recording to at least one data file, 

- decomposing at least one data file into IP- packets, 

- streaming packets to at least one recipient via telephony network or the Internet. 
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A subscriber terminal, comprising a software, an Internet connection and/or a 
telephony network connection in accordance with the invention is characterized in 
that, 

5 - the software is arranged to transmit and receive data and/or record and/or play 

files using both the Internet and/or the telephony network connection 
simultaneously or at separate times, 
- the software is arranged to use some or all of the same audio and/or video 
devices with both of the connections. 

10 

A network server comprising at least one media player, at least one dialer, at least one 
telephony connection and/or at least one data network connection in accordance with 
the invention is characterised in that, 

-the network server is arranged to receive, store and forward undelivered messages or 
15 copies of messages in data file format, 

-the network server is arranged to resend and/or reroute messages to directories, to at 
least one other server or voicemail box electronically in file format, and/or by playing 
the message down the phone line with at least one media player to at least one 
recipient and/or voicemail box. 

20 

A client terminal, comprising recipient contact information, at least one telephony 
and/or Internet connection means, media recorder, and a user interface, and audio 
and/or video recording and/or reproduction means, characterised in that, 
- at least one dedicated action from the user interface indicates at least one message 
25 recipient or a group of recipients from the associated recipient contact information 

and arranges the media recorder to record an audio and/or a video signal from the 
audio and/or video recording and/or reproduction means to a data file, which data 
file is further sent, played and/or reproduced to at least one indicated recipient 
using the said telephony and/or Internet connection. 

30 

In the following the invention will be described in greater detail with reference to 
exemplary embodiments in accordance with the accompanying drawings, in which 
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Figure 1 presents a method 10 in accordance with the invention as a flow diagram. 

Figure 2 presents another method 20 in accordance with the invention as a flow 
5 diagram. 

Figure 3 presents a further method 30 in accordance with the invention as a flow 
diagram. 

10 Figure 4 presents a method of address allocation in accordance with the invention. 

•i 

A 

Figure 5 presents an arrangement 50 of the subscriber terminal in accordance with the 
invention. 

15 Figure 6 presents an arrangement 60 of the user interface of the subscriber terminal in 
accordance with the invention. 

Figure 7 presents another arrangement 70 of the user interface of the subscriber 
terminal in accordance with the invention. 

20 

Figure 8 presents another embodiment 80 of the backup server in accordance with the 
invention. 

Figure 9 presents another embodiment 90 of arranging the backup server in 
25 accordance with the invention in a distributed and persistent fashion. 

Some of the preferable embodiments are described in the dependent claims. 

In phase 1 10 of figure 1 the message recipient is chosen. The recipient may be chosen 
30 by labeling the recipient with a pointer from the "contacts" file of the terminal device, 
the recipient may be chosen by speech recognition, a dedicated keyboard accelerator, 
hot key, dedicated key or any combinations or permutations of these in some 
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embodiments. Several recipients or a group may also be selected in some 
embodiments. In phase 120 the voice/video message is recorded in packet switched 
format, but other formats are also possible in some embodiments. In some 
embodiments the order of phases 110 and 120 may be reversed. Consequently, the 
5 recording is wrote to a data file, 130. During, in between or after any of these phases, 
directory lookup maybe executed in some preferable embodiments. The telephone 
number of the recipient is converted to an IP-address in one preferable embodiment. A 
prior art solution to directory lookup and conversion is presented in my patent 
application "Telenetwork directory template", FI1 9992774, which is taken here as 
10 reference. 

In one alternative embodiment, the software in the subscriber terminal has the 
telephone number of the software application stored. Both the telephone number and 
the current IP-address are given to a central server. Telephone numbers and IP- 

1 5 addresses can then be used interchangeably when contact is made between software 
applications. This results to the effect that information in packet switched format can 
be readily transmitted to telephone numbers, provided these telephone numbers have a 
corresponding IP-address. Directory lookup is here established as the interchange 
retrieval and/or comparison of any directory information such as email-, IP- address, 

20 URL, ISDN number, phone number or the like to another corresponding email-, IP- 
address, URL, ISDN number, phone number or the like directory from the network, 
network server and/or terminal in order to deliver the message to a directory. 

In phase 140 the data file is transmitted to the recipient via telephony network or the 
25 Internet. In some embodiments the subscriber terminal is a mobile station, and the 
messages are transmitted only on the condition that the radio field is adequate. In 
some embodiments attempts are made to send the message at various intervals, and if 
the attempt fails the message is postponed, typically for a further attempt. In many 
embodiments messages may be kept on standby for transmittal once favourable 
30 circumstances such as adequate network access, radio network access, radio signal 

strength, bandwidth, authentication or the like arise. Typically the transmission will be 
directed to an IP-address. Especially in cases where the IP-address of the recipient is a 
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dynamic one, the directory lookup is an advantageous feature. In some embodiments 
where the recipient has a static IP address, the IP-address need not be looked up 
separately every time. In some preferable embodiments IP-addresses of recipients are 
stored on the subscriber terminal. In some embodiments only static IP-addresses of 
5 recipients are stored. 

In some embodiments the message is sent by SS7-, GSM-, H323-, HTTP-, GSM-data, 
IP-RAN-, UMTS-, WAP-, Teldesic-, Inmarsat-, Iridium-, GPRS-, CDMA-data-, 
WCDMA-data-, HTTP-, H323-, SMS-, MMS-, email- LAN-, TCP/IP-, imode-, 

10 Globalstar- and/or WLAN- connection. In some embodiments the message is recorded 
in a file, which is attached to ah email, which email is then sent to the recipients. In 
some embodiments, the message is recorded to a data file, which is then encoded to 
text format. This text is then pasted/written to the email, which email is then sent to 
the recipients. In some embodiments the recipients are capable of playing the message 

15 from the text format, for example by decoding the text format back to a data file, 

which data file can then be played with a media player, like WAV- or MP3- player. In 
some embodiments, messages may be sent to several recipients, a group or several 
groups or groups and individuals by sending several copies of the same file/message 
or otherwise. 

20 

In phase 150 the recipient plays the data file. In some embodiments the message is 
played automatically after it is received. This feature is user configurable in some 
embodiments. The recipient may answer sender directly in phase 160. This may be 
done by pressing a button after the data file has been played and dictating another data 
25 file, which will be sent to the initial sender as a reply. In some embodiments it is also 
possible to forward messages to other recipients or third parties. The data file is 
typically an MP3-, WAV- or RealSystem Secure data file in some preferable 
embodiments. 

30 hi one special embodiment the inventive method is arranged with a mobile station. In 
one embodiment the method is realized with a computer program that is arranged to 
run on the SIM card (Subscriber Identity Module) of the mobile station. The SIM card 
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typically has a CPU, EEPROM-, ROM- and RAM- memories. In one phase of this 
special embodiment the message recipient, several recipients or a group may be 
chosen from the memory of the SIM card or from the memory of the mobile station, or 
it is inputted to the mobile station. When a dedicated action, such as pressing a button, 
5 is taken, a data file is recorded from the dictation, voice or video that is available. A 
media player/recorder located on the EEPROM and/or RAM of the SIM card or the 
memory of the mobile station typically does the recording of the file. In some 
embodiments the message itself is recorded to the RAM memory of the SIM card 
and/or the mobile station. After this the mobile station transfers the file to the 

10 recipient, to a secondary address of the recipient, or dials the telephone number of the 
recipient and plays the message as playback to the recipient when the call is answered 
or to the voicemail box if the call is answered by the voicemail box. The dialing of a 
data or a voice call may be realized from the SIM card as well in some embodiments 
using the proactive SIM feature of the SAT SIM Application Toolkit, which is 

15 specified in the phase 2+ of the GSM specification. 

In some embodiments of the invention, a special prefix and postfix may be stored on 
the network, the SIM or the mobile station memory, and is played prior to the 
recording in the data file. The prefix and/or postfix could play for instance: "In the 

20 following you will hear a message from Mr. Jero Jarvenpaa/'MESSAGE " This 
completed the message of Jero Jarvenpaa." The fact that the message was received 
could be detected in various ways in accordance with the invention. When the 
recipient or the voicemail box answers or hangs up, a DTMF tone may be transmitted 
and detected, which may be used to notify that the message was delivered. 

25 Alternatively the recipient could be asked to press a button or perform a dedicated 
action in order to signal that the message was indeed received and/or understood. If 
one or some of the recipients are unavailable, the message may be kept in memory and 
several other attempts to send the message may be taken. In some embodiments it is 
possible to set expiration conditions for the message, such as time, demands on 

30 memory by other functions, or various other conditions. In some embodiments the 

SIM and the mobile station may execute the method together, by for example the SIM 
performing the recipient selection and commands for forming or dialing connection, 
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and the mobile station by providing a media player. Many prior art terminals already 
feature a MP3 player or the like. 

In the phase 210 of figure 2 the message recipient is chosen by entering a telephone 
5 number or by choosing a name from an electronic phone book or the like. A recipient 
may be chosen on the basis of other directory information as well, for example on the 
basis of an IP-address. Following this, a voice/video message is recorded typically, but 
not necessarily in packet switched format in phase 220. In some embodiments the 
order of phases 210 and 220 may be reversed. 

10 

In phase 230 packets are streamed to the recipient via telephony network or the 
Internet. In some embodiments phases 230 and 210 may be concurrent. The recipient 
may receive the packet stream and play it in real time in phase 240. Alternatively, the 
recipient may also reassemble the packet stream to a data file in phase 240, which can 
15 be stored to the memory of the subscriber terminal and/or a server in the telephony 
network or on the Internet and played at a later time. Upon reception the recipient is 
given the opportunity to answer the sender in phase 260. In some embodiments, 
messages may be streamed to several recipients by sending several copies of the same 
packet stream. 

20 

During, in between or after any of the phases 210, 220, 230, directory lookup maybe 
executed in some preferable embodiments. 

In the phase 305 of figure 3 the message recipient is chosen by entering a telephone 
25 number or by choosing a name from an electronic phone book or the like. Following 
this, a voice/video message is recorded in packet switched format in phase 310. 
In some embodiments the order of phases 305 and 310 maybe reversed. 

The recording is written to a data file in phase 315. Following this, the data file is 
30 decomposed into IP-packets in phase 320, or packets of any other information 
transmission protocol e.g. H323, HTTP. Packets are streamed to the recipient or 
multiple recipients or a group via telephony network or the Internet in phase 325. In 



WO 02/17650 



11 



PCT/FI01/00701 



many embodiments packet streams may be kept on standby, discontinued and then 
continued for transmittal once favourable circumstances such as adequate network 
access, radio network access, radio signal strength, bandwidth, authentication or the 
like arise. 

During, in between or after any of these phases, directory lookup maybe executed in 
some preferable embodiments. 

Recipient plays packet stream directly and/or reassembles the data file in phase 330. 
The recipient may receive the packet stream and play it in real time. In some 
embodiments the packet stream is played automatically. Alternatively, the recipient 
may also reassemble the packet stream to a data file in phase 330, which can be stored 
to the memory of the subscriber terminal and/or on a server in the telephony network 
or on the Internet and played at a later time. Upon reception the recipient is given the 
opportunity to answer the sender in phase 335. 

The subscriber terminal is typically a mobile station equipped with an Internet 
connection and/or a telephony network connection. The mobile station typically 
abides to UMTS-, GSM-, WAP-, Teldesic-, Inmarsat-, Iridium-, GPRS-, CDMA-, 
HTTP-, H323-, SMS-, MMS-, and/or WCDMA- standards in some preferable 
embodiments. The subscriber terminal used in the method may also be a PC, PDA, 
Palm Computer or an Apple Macintosh computer equipped with an Internet 
connection and/or a telephony network connection in some preferable embodiments. 
The subscriber terminal in accordance with the invention has typically an operating 
system like Windows-, Windows NT-, Epoc-, Windows CE-, Unix-, Linux-, OS/2, 
Symbian, Epoc, PalmOS, Pocket PC, GEOS, MS-Stinger and/or Sybase. The 
execution of methods 10, 20, 30 is typically realised with a separate software 
application operating under the control of these operating systems. Alternatively, the 
execution of methods 10, 20, 30 maybe realised with software that is integrated to any 
of the above operating systems. In some embodiments the execution of methods 10, 
20, 30 and their favourable permutations and further embodiments maybe realised by 
OEM software for mobile stations, modems, computers, radio, SIM cards and/or line 



WO 02/17650 



PCT/FI01/00701 



12 

cards. Li some embodiments the execution of methods 10, 20, 30 may be realised with 
software that is integrated to any email client software, such as Microsoft Outlook, 
Outlook Express or the like. In some embodiments the execution of methods 10, 20, 
30 maybe realised with software that is developed using SAT (SIM Application 
5 Toolkit) or WTAI (Wireless Telephony Application Interface) of WAP (Wireless 
Application Protocol). 

The information transfer in accordance with the inventive method follows a 
harmonious information transfer protocol, which is typically packet switched in some 

10 embodiments and compatible with the various hardware and software setups of the 
subscriber terminals. Typically different hardware setups of subscriber terminals have 
different client software programs, which are all intercompatible. For example in 
some preferable embodiments the data file is of MP3- or WAV-, Or RealSystem 
Secure- format which is understood by all software programs residing in subscriber 

15 terminals in accordance with the invention. Various other compression methods may 
also be employed to produce the data file. 

The subscriber terminals need also be compatible to handle the direct packet stream in 
accordance with the invention, in some preferable embodiments. This packet stream 
20 may be an IP- (Internet Protocol) multicasting, TCP- (Transmission Control Protocol) 
and/or HDP- (User Datagram Protocol) data stream. The data file may also be 
transmitted using these protocols or others in some preferable embodiments. 

Provided the receiving subscriber terminal is incompatible to receive the transmitted 
25 format, the format may be adapted to the data format of the recipient at a central 
server in the telephony network, cellular network and/or on the Internet. 
If the recipient is unable to receive the voicemail the message may be stored on a 
central server for the time being. If the subscriber terminal is an analog phone, or 
otherwise unable to decipher and reproduce the data format of the voicemail, the voice 
30 mail can always be played down the phone line from the server as a last resort. 

For all cases where the recipient subscriber terminal cannot reproduce or store the 
message, a backup server may be designated in the transmission in some preferable 
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embodiments. During, before, in between or after any of the phases of methods 10, 20, 
30 or their permutations or embodiments an address tag, giving the IP-address, 
telephone number, email address or any other directory information of the backup 
server can be attached to the transmission. The backup server is found on the basis of 
5 this address tag in some preferable embodiments. In some embodiments the 

undeliverable message is routed to the voicemail box, email or some other directory of 
the recipient if the original delivery is unsuccessful!. In some embodiments this 
address tag is demanded as the prerequisite for backup delivery. 

10 Voice recognition may be employed during, before, in between or after any of the 
phases of methods 10, ^0, 30. A Regret function maybe employed during, before, in 
between or after any of the phases of methods 10, 20, 30 in order to destroy an 
unwanted intermittent or complete message. In some preferable embodiments, voice 
recognition is used to convert the dictation into a written email, SMS-, MMS- 

1 5 message or the like. 

In figure 4 the packet stream and/or data file may be transmitted to the telephone 
number directly through the telephony network, for example using such protocols as 
SS7 and/or OTA (Over the Air) or as bursts or otherwise. In this case the recipient 

20 typically has a modem receiving the transmission in data mode. If the message cannot 
be delivered to the telephone number, it maybe directed to the IP-address 430 of the 
recipient. The IP-address 430 may be looked up from a central server 450 in any phase 
of the process, before the transmission is began, after the failure of the reception to the 
telephone number or during the transmission. If an IP-address is unavailable, the 

25 voicemail may still be emailed to the email address of the recipient provided this is 

available. In some preferable embodiments the message may be directed to some other 
preferable electronic address, like the ISDN number, voicemail box, cellular 
voicemail box or another electronic address. All reroutings may be handled via at least 
one backup server in some embodiments. 

30 



The subscriber terminal 500 of figure 5 in accordance with the invention comprises 
audio and/or video devices 550, like a microphone, speakers, a video camera and/or a 
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digital camera. Audio/video devices 550 are controlled by software that typically 
incorporates or is able to use both the audio/video device drivers 540 and a media 
player 530. These software 540, 530 may transmit and receive data and/or record 
and/or play files using both the Internet and/or the telephony network connection 
5 simultaneously or at separate times in some preferable embodiments. 

In one preferable embodiment of the inventive subscriber terminal in accordance with 
the invention, a free IP-conference maybe arranged to be attempted first, and if this 
fails the call can be made through the telephony network with the cheapest or most 
1 0 reliable carrier as described in my patent application FI1 99606 1 3, which is taken here 
as reference. , * 

In one preferable embodiment a signal like an SMS-message, MMS-message, DTMF- 
tone, PING-signal or another signal may be used to initiate the subscriber terminal of 
15 this type to form an Internet connection to a specific IP-address. An IP-conference can 
be set in this way in accordance with my patent application FI20000785, which is 
taken here as reference. 

Ia one preferable embodiment of the inventive subscriber terminal in accordance with 
20 the invention, the software 530, 540 are arranged to operate voice hyperlinks in 

accordance with my patent application FI20000249, which is taken here as reference. 

The subscriber terminal in accordance with the invention 500 also allows voicemail to 
be sent through both connections 510, 520. In some preferable embodiments the 
25 telephony network connection 520 is simply a voice connection and the audio/video 
player 530 is arranged to play the voice message to the recipient subscriber terminal, 
where it is recorded in some preferable embodiments. In this embodiment typically the 
telephone number is contacted. 



30 



In some preferable embodiments the IP network connection 520 is a data connection 
like a GSM-data, IP-RAN, TCP/IP, CDMA, GSM, GPRS, WCDMA, UMTS, 
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Teldesic, Iridium, Inmarsat, IP-RAN, WLAN, Globalstar, DIGI-TV, SS7, HTTP, 
H323, IrDA, Bluetooth, NADC, PCS, JDC, ISDN and/or imode connection. 

In a further advantageous embodiment there exists a common data-BUS to the audio 
5 and/or video devices from both the Internet connection and the telephony network 
connection. This way the same audio/video devices 550 may be used flexibly in IP- 
conferences, teleconferences, voicemail and/or packet switched voicemail. All these 
modes of operations and their permutations are controlled by the software 540, 530. 
The software 530, 540 is typically realised as a Windows-, Windows NT-, Epoc-, 
10 Windows CE-, Unix-, Linux-, OS/2, Symbian and/or Sybase application. It may also 
be realised as an integral part of any of the said operating systems. 

In some preferable embodiments the software 530, 540 comprises also voice 
recognition software in accordance with the invention. 

15 

In figure 6 the user interface 600 of a preferable subscriber terminal is illustrated. The 
user interface 600 is typically a PDA and/or a mobile stations front- or backend, or a 
virtual telephone on a PC screen. In one preferable embodiment, once the VSMS, or 
any other button or a combination of buttons is pressed, a recording is begun, and the 

20 message may be transmitted in accordance with the inventive methods 10, 20 and/or 
30. The release of the VSMS button, or any other button or their combination may 
finish the recording and send the message in accordance with the invention. In some 
embodiments the buttons may be pressed physically or with a mouse pointer from a 
screen. In some embodiments separate dedicated keys, combinations of keys, shortcut 

25 keys, keyboard accelerators or the like are used to record and deliver messages. In 
some embodiments, dedicated keys, combinations of keys, shortcut keys, keyboard 
accelerators are used to record and deliver messages specifically to recipients to whom 
the dedicated keys, combinations of keys, shortcut keys, keyboard accelerators are 
dedicated to. For example, in one embodiment the button "9" or Ctrl+M could be used 

30 to record and deliver the message e.g. to the "M"other of the sender, i.e. mother of the 
sender. Naturally any other logical relationship between the hot key and the recipient 
is possible. 
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In one preferable embodiment the arrival of the message, or a packet stream 
containing the message may be indicated on the screen 610, or by flashing a light on 
the VSMS button or any other button or their combination. Once the recipient holds 
5 the button down the message is played from the audio devices of the subscriber 

terminal. In some preferable embodiments the inventive subscriber terminal features 
also an inbox for arrived messages. 

In one embodiment the user interface 600 is the user interface of a mobile station. In 

10 one embodiment the method is realized with a computer program that is arranged to 
run on the SIM card (Subscriber Identity Module) of the mobile station. The SIM card 
typically has a CPU, EEPROM-, ROM- and RAM memories. In one phase of this 
special embodiment the message recipient, several recipients or a group maybe 
chosen from the memory of the SIM card or from the memory of the mobile station, or 

15 it is inputted to the mobile station. When a dedicated action, such as pressing a button, 
is taken, a data file is recorded from the dictation, voice or video that is available. A 
media player/recorder is typically located on the EEPROM of the SIM card or the 
memory of the mobile station does the recording of the file. In some embodiments the 
message itself is recorded to the RAM memory of the SIM card and/or the mobile 

20 station. After this the mobile station transfers the file to the recipient, to a secondary 
address of the recipient, or dials the telephone number of the recipient and plays the 
message as playback to the recipient when the call is answered or to the voicemail box 
if the call is answered by the voicemail box. The dialing of a data or a voice call may 
be realized from the SIM card as well in some embodiments using the proactive SIM 

25 feature of the SAT SIM Application Toolkit, which is specified in the phase 2+ of the 
GSM specification. 

In some embodiments of the invention, a special prefix and postfix may be stored on 
the network, the SIM or the mobile station memory, is played prior to the recording in 
30 the data file. The prefix and/or postfix could play for instance: "In the following you 
will hear a message from Mr. Jero Jarvenpaa. "MESSAGE " This completed the 
message of Jero Jarvenpaa." The fact that the message was received could be detected 
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in various ways in accordance with the invention. When the recipient or the voicemail 
box answers or hangs up, a DTMF tone may be transmitted and detected, which may 
be used to notify the sender or the network that the message was delivered, e.g. with 
an SMS message of a flash message on the screen. Alternatively the recipient could be 
5 asked to press a button or perform a dedicated action in order to signal that the 

message was indeed received and/or understood. If one or some of the recipients are 
unavailable, the message may be kept in memory and several other attempts to send 
the message may be taken. In some embodiments it is possible to set expiration 
conditions for the message, such as time, demands on memory by other functions, or 
10 various other conditions. In some embodiments the SIM and the mobile station may 
execute the methods 10, 20, 30 or any permutation of these together, by for example 
the SIM performing the recipient selection and commands for forming or dialing 
connection, and the mobile station by providing a media player. Many prior art 
terminals already feature an MP3 player or the like. 

15 

Figure 7 presents a special embodiment of the invention, which is typically realized as 
a software user interface on the screen of a terminal device. 720 is the display that 
shows who is/are the current recipients. The display 720 may simply list, scroll or 
otherwise display the current recipients of messages. In some preferable embodiments, 

20 the recipient may simply be manipulated by voice recognition. By pressing button 710 
with a mouse pointer or some other pointer, the recording is begun. The recorder of 
the device records the message until the button is released, or pressed for a second 
time. When the recording is stopped, the message is sent to the recipients. In some 
embodiments the message is sent by GSM-data, IP-RAN-, UMTS-, WAP-, Teldesic-, 

25 Inmarsat-, Iridium-, GPRS-, CDMA-data-, WCDMA-data-, HTTP-, H323-, SMS-, 

MMS-, email- LAN- and/or WLAN- connection. In some embodiments the message is 
recorded in a file, which is attached to an email, which email is then sent to the 
recipients. In some embodiments, the message is recorded to a data file, which is then 
encoded to text format. This text is then pasted/written to the email, which email is 

30 then sent to the recipients. In some embodiments the recipients are capable of playing 
the message from the text format, for example by decoding the text format back to a 
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data file, which data file can then be played with a media player, like WAV- or MP3- 
player. 



In some embodiments, it is possible to utilize Autoplay upon reception. In this 
5 embodiment, the audio/video message is played automatically upon reception of the 
message. Typically, this means opening the file containing the message, and possibly 
employing decoding and/or decryption methods in some embodiments. In some 
embodiments where the message arrives by playback down the phone line, Autoplay 
is used to Auto answer these phone calls and play the call to the speaker(s) of the 
10 terminal. 

A 

Figure 8 present a special embodiment of the invention, utilizing a server for backup 
of messages. The messages are exchanged directly between the subscriber terminals 
820, 821, 822, 823 in the first instance, but if a message is undeliverable it maybe 

15 returned to the backup server 810 or to the sending terminal in some embodiments. 
Further attempts to resend or reroute to another directory, such as email, voicemail 
box, IP-address and/or telephone number may then be initiated from the server 810 or 
the original sending terminal. In some embodiments the server 810 may also be used 
for relaying messages. Upon delivery, or unsuccessful delivery acknowledgement 

20 messages may be fired from the receiving terminal e.g. 823 to the sending terminal 

e.g. 820, or to the backup server 810. Likewise, upon delivery or unsuccessful delivery 
acknowledgement messages may be fired from the backup server 810 to the sending 
terminal e.g. 820. 

25 In some preferable embodiments the server 810 comprises a DBMS (Database 

Management System), a database, a dialer and a media player. Once the server 810 has 
the undelivered file containing the message, it will typically be stored in a database. 
The file may later be fetched from the database and be resent and/or rerouted in 
accordance with the invention. It is also possible to play the message to the recipient 

30 or to the recipient(s) voicemail box automatically, if the message cannot be delivered 
to the recipient(s) subscriber terminal, hi some embodiments this is done 
automatically by the dialer dialing the telephone number of the recipient, then waiting 



WO 02/17650 



19 



PCT/FI01/00701 



for an answer, and then playing the message by a media player. Voice recognition may 
be employed in recognizing when the recipient has answered and is ready to listen to 
the message, typically after he has quit speaking, or the voicemail box has quit 
speaking and silence is detected. Direct file transfer to a file based voicemail box, or 
another backup server of the same type as 810 is also possible, by FTP, UDP, TCP/IP, 
HTTP, H323 or any other information transfer protocol. In some embodiments with a 
plurality of backup servers, the message is transferred to the backup server nearest to 
the recipient, or with the lowest latency to the recipient. 

A Regret function may be employed during, before, in between or after any of the 
phases of methods 10, 20, 30 in order to destroy an unwanted intermittent or complete 
message, and it may be sent to the backup server 810 directly which will handle the 
message cancellation even when it has already been sent. In some embodiments, regret 
signals are sent even to the receiving terminal e.g. 823 and the message is destroyed 
upon receipt of the regret message on the receiving terminal, in some embodiments 
after the receiver has played the message or in some embodiments irrespective of this. 

Figure 9 present a special embodiment of the invention, utilizing a Peer to Peer Server 
network. In this embodiment all or some of the clients at a terminal 901, 902, 903, 
904, 905, 906, 907 may also operate as servers. In this embodiment, if a recipient 
client is unavailable, the message which cannot be delivered will be stored at some 
peer terminal 901, 902, 903, 904, 905, 906, 907. In some embodiments it will remain 
at the sender's terminal, and attempts to resend are made continuously or at regular 
intervals. In some embodiments, the undelivered message is stored at a peer terminal 
which is closest to the destination terminal. 

The invention has been explained above with reference to the aforementioned 
embodiments, and several advantageous features of the invention have been 
demonstrated. The present inventive method allows voicemail to be sent directly to 
telephone numbers in a flexible manner from both software applications and mobile 
stations. The inventive method and means allows instantaneous voicemail to be sent 
and received from and to any Internet compatible device on the basis of the telephone 
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number of that device. There will be only an optional need for a central server storing 
the messages. 

IP-conferences and Internet calls maybe arranged with the telephony audio devices in 
5 accordance with the inventive subscriber terminal. Likewise, voice hyperlinks are easy 
to operate with the same audio devices. The transmission, reception and reproduction 
of packet switched voice mail will also be seamless with the subscriber terminal in 
accordance with the invention. This makes the exchange of short messages faster than 
with the SMS, as messages need not be written, and faster than a telephone call, as 

10 one does not have to wait the recipient to answer the telephone. All of these features 

'I 

allow greater flexibility<tod cost savings to the consumer, as free Voice & Video over 
IP may be practically employed. 

For additional advantage the invention also introduces a favourable inventive user 
15 interface and method for exchanging voicemail seamlessly and instantaneously 

between IP-addresses, email-addresses, telephone numbers, and/or ISDN addresses. 

The invention has been explained above with reference to the aforementioned 
embodiments. However, it is clear that the invention is not only restricted to these 
20 embodiments, but comprises all possible embodiments within the spirit and scope of 
the inventive thought and the following patent claims. 



25 
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Patent claims 

1. A voicemail messaging method, comprising at least one subscriber terminal, 
5 characterised by the steps of, 

- choosing at least one message recipient or a group (1 10), 

- recording at least one voice/video message (120), 

- writing at least one recording to at least one data file (130), 

- transmitting at least one data file to at least one recipient via telephony network or 
10 the Internet (140), 

i 

2. A voicemail messaging method, comprising at least one subscriber terminal, 
characterised by the steps of, 

- choosing at least one message recipient or a group (210), 
15 - recording at least one voice/video message (220), 

- streaming data packets to at least one recipient via telephony network or the 
Internet (230), 

at least one recipient receives and/or reassembles packet stream (240), 

20 3. A voicemail messaging method, comprising at least one subscriber terminal, 
characterised by the steps of, 

- choosing at least one message recipient (305), 

- recording at least one voice/video message 310), 

- writing at least one recording to at least one data file (3 1 5), 
25 - decomposing at least one data file into IP- packets (320), 

- streaming packets to at least one recipient via telephony network or the Internet 
(325). 

4. A method according to claims 1, 2 and/or 3, characterised in that, the recipient is 
30 chosen on the basis of the telephone number (420), or a name corresponding to the 

recipient's telephone number in the phone book of the subscriber terminal, by labeling 
the recipient with a pointer from the "contacts" file of the terminal, device, by speech 
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recognition, a dedicated keyboard accelerator, hot key, dedicated key or any 
combinations or permutations of these. 

5. A method according to claims 1, 2, 3 and/or 4, characterised in that, the said 
5 telephone number (420) and/or name is converted to an IP-address (430), email 

address (440) and/or an ISDN address from a central directory on the Internet, in the 
telephony network, or from the memory of the said subscriber terminal. 

6. A method according to claims 1, 2 and/or 3, characterised in that, at least one 
10 subscriber terminal is a TCP/IP, CDMA, GSM, GPRS, WCDMA, UMTS, Teldesic, 

Iridium, Inmarsat, IP-RAN, WLAN, Globalstar, DIGI-TV, SS7, HTTP, H323, IrDA, 
Bluetooth, NADC, PCS, JDC, ISDN, TDMA, EDGE and/or imode compliant mobile 
station or a Personal Computer or an Apple Macintosh computer and/or a PDA. 

15 7. A method according to claims 1, 2 and/or 3, characterised in that, if the receiver is 
unavailable the voicemail messages maybe stored on a central server. 

8. A method according to claims 1, 2, 3 and/or 7, characterised in that, 

- if the receiving terminal is unable to reproduce the data format, the data 

20 transmission may be stored on a central server, and the server may convert the data 
format to a reproducible data format and send it to the same directory or another 
directory, 

- and/or the server may convert the data format to sound and play it to the receiving 
subscriber terminal through a telecommunications connection and/or an Internet 

25 connection in real time or at a later time. 

9. A method according to claims 1, 2 and/or 3, characterised in that, the packets are 
IP-packets, the data file is a MP3- or an WAV- file, and their transmission and 
reception conforms to TCP/IP, CDMA, GSM, GPRS, WCDMA, UMTS, Teldesic, 

30 Iridium, Inmarsat, IP-RAN, WLAN, Globalstar, DIGI-TV, SS7, HTTP, H323, IrDA, 
Bluetooth, NADC, PCS, JDC, ISDN, TDMA, EDGE and/or imode standards. 
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10. A method according to claims 1, 2 and/or 3, characterised in that, at least one 
recipient receives and plays the data file and/or packet stream, and the recipient is 
provided with a chance to answer at least one sender and/or at least one recipient. 

1 1 . A method according to claims 1, 2 and/or 3, characterised in that, at least one of 
the phases 140, 230, 325 features dialing a connection and/or playing the file as 
playback through the communication connection or the telephone line. 

12. A subscriber terminal (500), comprising a software (530, 540), an Internet 

connection (510) and/or a telephony network connection (520), characterised in that, 

"i 

- the software (530, 540) is arranged to transmit and receive data and/or record 
and/or play files using both the Internet (510) and/or the telephony network 
connection (520) simultaneously or at separate times, 

the software (530, 540) is arranged to use some or all of the same audio and/or 
video devices (550) with both of the connections (510, 520). 

13. A subscriber terminal (500) according to claim 12, characterised in that, the 
software application (530) is an MP3- or a WAV- media player or another media 
player in connection with the software and/or communication drivers for the Internet 
connection devices (510) and/or telephony network connection devices (520). 

14. A subscriber terminal (500) according to claim 12, characterised in that, the 
subscriber terminal (500) is a TCP/IP, CDMA, GSM, GPRS, WCDMA, UMTS, 
Teldesic, Iridium, Inmarsat, IP-RAN, WLAN, Globalstar, DIGI-TV, SS7, HTTP, 
H323, IrDA, Bluetooth, NADC, PCS, JDC, ISDN, TDMA, EDGE and/or imode 
compliant mobile station or a Personal Computer or an Apple Macintosh computer 
and/or a PDA. 

15. A subscriber terminal (500) according to claim 12, characterised in that, the 
subscriber terminal (500) is a UMTS-, GSM-, WAP-, Teldesic-, Inmarsat-, Iridium-, 
GPRS-, CDMA-, and/or WCDMA mobile station or a Personal Computer or an Apple 
Macintosh computer and/or a PDA, which has a common data-BUS to the audio 
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and/or video devices (550) from both the Internet connection (510) and the telephony 
network connection (520). 

16. A software application according to claim 12 and/or 13, characterised in that, at 
5 least one software (530, 540) is an integral part of the operating system of the 

subscriber terminal (500), and/or or an application operating under the control of the 
operating system of the subscriber terminal (500). 

17. A network server comprising at least one media player, at least one dialer, at least 
10 one telephony connection and/or at least one data network connection, characterised 

in that, * 

-the network server is arranged to receive, store and forward undelivered messages or 
copies of messages in data file format, 

-the network server is arranged to resend and/or reroute messages to directories, to at 
15 least one other network server or voicemail box electronically in file format, and/or by 
playing the message down the phone line with at least one media player to at least one 
recipient and/or voicemail box. 

18. A network server as claimed in 17, characterised in that, the directory of 
20 resending and/or rerouting is the email or the voicemail box of the recipient. 

19. A client terminal, comprising recipient contact information, at least one telephony 
and/or Internet connection means, media recorder, and a user interface, and audio 
and/or video recording and/or reproduction means, characterised in that, 

25 - at least one dedicated action from the user interface indicates at least one message 
recipient or a group of recipients from the associated recipient contact information 
and arranges the media recorder to record an audio and/or a video signal from the 
audio and/or video recording and/or reproduction means to a data file, which data 
file is further sent, played and/or reproduced to at least one indicated recipient 

30 using the said telephony and/or Internet connection. 
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20. A client terminal in accordance with claim 19, characterised in that, the said 
dedicated action may be given orally and recognized by speech recognition, by a press 
and/or release of real or virtual button, a dedicated keyboard accelerator, hot key, 
dedicated key or any combinations or permutations of these. 
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